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SYSTEM FOR ACCESSING, DISTRIBUTING AND MAINTAINING 
5 VIDEO CONTENT OVER PUBLIC AND PRIVATE INTERNET 

PROTOCOL NETWORKS 

CLAIM OF PRIORITY 
This application claims priority from co-pending U.S. Provisional Patent 
10 Application No. 60/147,653 filed 8/6/99 entitled SYSTEM FOR ACCESSING, 

DISTRIBUTING AND MAINTAINING VIDEO CONTENT OVER A COMPUTER 
NETWORK which is hereby incorporated by reference, as is set forth in full in this 
documem, for all purposes. 

15 BACKGROUND OF THE INVENTION 

This invention relates in general to infonnation transferred over computer 
. networks and more specifically to a system for processing and distributing video 
information over various types of Internet protocol networks.. 

An important feature of the global Internet is the ability to make a large 
20 amount of information available to many users. Not only shoiild the information be 
. immediately available, but it is desirable to provide for a fast and intuitive interface tor 
finding the information or content desired. 

High-bandw^idth content, such as digital video, has proven to be difficult to 
handle on the Inlcmet. Because of the large size of video files, and the high connection 
25 speeds needed to view the files, it is especially important, yet difficult, to provide users 
with efficient ways to search and access video content. Efficient searching is necessary 
so that a user does not have to wade tltrough many minutes of video information to 
detennine that soughl-after inforaiation is, indeed, within the video program. 

One of the ways that the prior ail has used to reduce video bandwidth is to 
30 compress the video data before storing and distributing it on a network. Various 

compression schemes and data formats can be used. For example, MPEG, Windows 
Media, RealVideo, etc. can be used. Significant degradation or artifacts can be 
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introduced into the video data as a result of a poorly implemented encoding process. 
These artifacts result in a lower-quality video/audio experience for the end-user. 

Thus, it is desirable to provide a video access, management and 
distribution system that provides users quick access to the video content they desire, 
5 provides a system for preparing video, or other media, for storage, access and distribution 
over a computer network, and provides the highest quality video content available over 
computernetworks. 

SUMMARY OF THE INVENTION 
10 The present invention provides a system for preparing, distributing and 

accessing video content in an Internet protocol network. Aspects of the system provide 
for accessing, distributing and maintaining digital video or other multimedia content. 
Video content is acquired from content providers and prepared for Internet (or other 
computer network) access. 
13 Searchabiliiy of desired video content is provided to users of the system by 

linking \ idco content to searchable text. The searchable text is accessed via a database 
where relational queries are used to identify desired content. Portions, or chapters, of the 
video are linked to a unique text description. This allows for indexing of video so that a 
viewer, or user, can search for specific infomiation and receive access to video clips that 
20 contain the information searched for, while avoiding clips that don't have any value to the 
user. 

Access of the video by end users is facilitated by maintenance of multiple 
video servers that provide access to the content. Distribution of video broadcasts can be 
in real-time or on demand. A prefeired embodiment uses both satellite and locally stored 

25 digital video distribution. Video infonriation is pre-processed to minimize artifacts, 
degradation and other imdesirable effects that can be introduced into the video 
infomiation due to compression. The speed of transmission to an end user from each of 
multiple ser\'ers is tested prior to transmission of the video stream so that the server 
closest to the user on the Internet can be used for the transmission, reducing the chance of 

30 .degradation due to network traffic conditions. 

One embodiment of the invention provides a method for encoding a video 
signal, the method comprising increasing the saturation level of the video signal to just 
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below visual distortion of the video, selecting a high contrast and brightness levels, 

converting the video signal to digital data, and compressing the digital data. 

Another embodiment includes a method of encoding an audio signal, the 
method comprising increasing the volume of a predetermined frequency range of the 
5 audio signal, reducing the variability in the dynamic range of the audio signal; converting 
the audio signal to a digital data; and compressing the digital data. 

An aspect of the invention provides an encoding system that uses standard 
components to achieve a low-cost, efficient, and easily serviceable chapterizing and 
encoding process for handling a large amount of video processing in a uniform and 
10 parallel manner. 

Yet another embodiment provides a method for distributing video over the 
Inicmct. ihc method comprising obtaining the Internet Protocol (IP) address of a 
computer used by a user to log onto a predetennined website; using the obtained DP 
ailJrcss lo dcicrmine the pliysical location of the user's computer; perfonning a route 
15 aiuh.sjs lo Jcicci seiver computers between a starting serx^er computer and the user's 
CDHipuicr, usm^ the route analysis and IP address info nnation to identify a ser>'er 
cini;puicr m proximity to the user's computer; and transferring video information from 
the sen cr cuniputer to the user's computer. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a generalization of the system of the present invention; 
Fig. 2A is an illustration of a computer system suitable for use with the 
present invention; 

Fig. 7B illustrates subf^ystems of the computer system nf Fig. 2A; and 
25 Fig. 3 shows a diagram illustrating video* encoding in a preferred 

cnihoJiincDl. 



DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 
A preferred embodiment of this invention is to be fielded by Teclinology 

..30...... Educmi.o.o..Mclworkj Inc., or "TENTV''. This patent discusses system aspects of the 

invention. Other aspects are discussed in the following co-pending patent applications 
which arc hereby incorporated by reference as if set forth in full in this application: 
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Patent Serial No. [TBD] discusses user-interface aspects of the invention; 



and 



Patent Serial No. [TBD] discusses enterprise aspects of the invention. 



5 Note that, although the term "video" is used to refer to the specific content 

that is stored, processed, or otherwise manipulated by the subject invention, this term 
merely refers to the type of media handled by a preferred embodiment of the invention. 
The term "video" for purposes of determining the scope of the invention is defined as 
including all types of media, or content, that can be stored, distributed, accessed or 
10 processed in a network and/or computer system. For example, other media types within 
the scope of the invention include audio, images and data. 

System Overview 

Fig. 1 shows H general! /nt.i on of the system of the present invention, 

15 In Fig. 1, network 100 represents a large network, such as the Internet, 

which includes many processing devices that perform data storage, transfer and access 
functions. In the Internet, for example, such devices are called ''ser\'er'' computers. 
Servers are indicated by rectangles such as server 1 02. Servers may perform their roles in 
isolation, such as server 1 02. Other sen'ers can be part of a localized network such as a 

20 network on a college or busiriess campus, or a LA>]. Collections of servers that operate 
under the control or domain of a localized management entity, such as a corporate or , 
campus network, arc grouped as shown at 130. In general, the Internet allows for wide- 
ranging, diverse and changing collections of ser\'ers under control of different 
organizations as long as the servers iidhcic to ceilain well-defined standaids such as the 

25 domain name ser\ace (DNS), Internet Protocol, etc. 

In a preferred embodiment of the invention, a primary company acts as a 
ser\'ice provider for video access, encoding, distribution and management. The goal of 
the primar>' company is to obtain video content and make the video conieni available lo- 
users, or viewers, in an efficient and economical manner. In Fig. L entities 120, 130 and 

30 140 are customers of a primary company which operates video origination and encoding 
services represented by 171, 1 10 and 173. Video is distributed to customers by satellite 
link 172 directly to customers, as shown at 174, via satellite link to co-located encoders 
and servers as represented by 1 12, 1 14 and 1 16; or directly to the Internet after encoding 
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by the primary company as shown at 1 10. Remote webcast 1 73 represents direct 
transmission of a live recording to the Internet as where the video.is encoded in real-time 
and immediately placed onto the Internet. Still other forms of distribution are possible. 
Cable networks, fiber optic, wireless or other conmiunication channels can carry the data 
5 as opposed to a satellite link. All fonns of network transfer are considered within the 
scope of the invention. 

Given the nature of the Internet, the video information can reside on any 
server and be accessed by any user such as user 141 . However, the quality of the video 
playback, and the speed with which the user receives responses to queries depends on a 

10. number of factors. For example, the speed of the network between a sending server, e.g., 
sending server 112, and user Ml is a factor. The speed between company 130's Internet 
connection point and the rest of company ISO's users is another factor. 

The speed of each communication link between intermediary servers and 
between the user and the Internet affects the transfer rate, time delays and overall quality 

15 of the video transmission, in general, geographic distance can be an approximate 

measure of the quality of ser\'ice that a user can expect. The closer that the user is to the 
sending server the more likely that the transfer rate will be faster. 

Companies such as 120 and I ^0 (or other entities) may wish to provide 
video content to their employees, customers, or others. However, since supporting video 

20 servers, databases and other aspects of video data management require complex 

installations of storage, sen'ers, personnel and other resources (discussed below), such 
companies are likely to want the support of video content performed by a company such 
as primary company 110, therefore, primary company 1 10 can obtain video content 
from a company, such as companies 120 or 130, and make such video content directly 

25 available to user 1 10 via primary company 1 lO's ser\'er 112,114, and 1 1 6. Alternatively, 
primary company 110 can niakc the video available through company 120's server 122, 
Thus, videos resident on server 1 12 can be transferred over the Internet to server 122 
before being delivered to users in company 120. 

Video can be sourced at more than one ser\^er. For example, the desired 

-30 video may already be resident on server 114 so that ther« is no need -to U ausfcr video... 

information from server 1 1 2 to server 1 1 4. Or. the video infomiation can be on a server, 
such as server 116, that happens to be the closest - either geographically, or Scorn a 
nenvork transfer standpoint - to user 141. SatelHte receiver antennas such as 112 and 1 14 
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can be used to download video or other data from satellites for fast transmission of 
information to servers on the Internet at locations 1 12 and 1 14. 

Users who do not wish to view video on their computer desktop and opt 
for viewing on a standard television or a large scale projection event in a theater can view 
5 video in real time uplinked from 170 to satellite 172 and received at company 174. 
Company 1 10 offers the services of broadcasting live or taped video for viewing on 
standard televisions equipped with a satellite receiving antenna. 

The following section describes standard hardware suitable for use with 
the present invention. 

10 

Doscrintion of Hardware 

Fig. 2A is an illustration of multimedia computer system 1 including 
display 3 having display screen 5. Cabinet 7 houses standard computer components (not 
shown) such as a disk drive, CDROM drive, display adapter, sound card, network card, 

1 5 randv>ni access memor>' (RAM), centra] processing unit (CPU), and other components, 
suhs% stems and devices. User input devices such iis mouse II having buttons 13, and 
ke>ix>ard 9 are shown. Other user input devices such as a trackball, touch-screen, 
diyiii/niL; tablet, etc. can be used. In general, the computer system is illustrative of but 
one i>pc of computer system, such as a desktop computer, suitable for use with the 

20 present mvention. Computers can be configured with many different hardware 
eonipcMienis and can be made, in many dimensions and styles (e.g., laptop, palmtop, 
peniop. scrxer, workstation, mainframe). Any hardware platform suitable for performing 
the pri>ccssing described herein is suitable for use with the present invention. 

Fig. 2B illustrates subsystems that might t>'pically be found in a computer 

25 such as computer 100- 

In Fig. 2, subsystems within box 20 are directly interfaced to internal bus 
22. Such subsystems typically are contained within the computer system such as within 
cabinet 7 of Fig. 2A. Subsystems include input/output (1/0) controller 24, System 
Random .Access Memory (RAM) 26, Central Processing Unit (CPU) 28, Display Adapter 

30 30. Serial Pon 40, Fixed Disk 42 and Ncnvork Interface Adapter 44. The use of bus 22 
allows each of the subsystems to transfer data among the subsystems and, most 
imponanily, with the CPU. External devices can communicate with the CPU or other 
subsystems via bus 22 by interfacing with a subsystem on the bus. Monitor 46 connects 
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to the bus through Display Adapter 30. A relative pointing device (RPD) 48 such as a 
mouse connects through Serial Port 40. Some devices such as Keyboard 50 can 
communicate with the CPU by direct means without using the main data bus as, for 
example, via an interrupt controller and associated registers (not shown). 
5 As with the external physical configuration sliown in Fig. 2A, many 

subsystem configurations are possible. Fig. 2B is illustrative of but one suitable 
configuration. Subsystems, components or devices other than those shown in Fig. 2B can 
be added. A suitable computer system can be achieved without using all of the 
subsystems shown in Fig. 2. For example, a standalone computer need not be coupled to 

10 a network so Network Interface 44 would not be required. Other subsystems such as a 
CDROM drive, graphics accelerator, sound card etc. can be included in the configuration 
wiihout affecting .the performance of the system of the present invention. 

Fig. 2 A is a generalized diagram of a typical network. 

In Fig. 2A, the network company 120 includes several local networks 

1 5 coupled to the Internet. Although specific network protocols, physical layers, topologies, 
and other network properties are presented herein, the present invention is suitable for use 
with any network. 

In Fi^. 7 A., compnny 120, computer user 123 is connected to sei-ver 122. 
This coimection can be by a network such as Ethernet, Asynchronous Transfer Mode, 
20 IEEE standard 1553 bus, modem connection, Universal Serial Bus, etc. The 
communication link need not be a wire but can be infrared, radio wave transmission, etc. 
ser\'er 123 is coupled to the Internet. The Internet is shown symbolically as a collection 
of serv^er routers 101 and 103. Note that the use of the Internet ifor distribution or 
communicaiion of infomiation is not strictly necessary to practice the present invention 
25 but is merely used lo illustrate a preferred embodiment, below. Further, the use of server 
computers and the designation of server and ciiait machines is not cmcial to an 
implementation of the present invention. User 123 from company 120 can be connected 
directly to the Inleniei. Server 122 in company 120's connection to the Internet is 
typically by a relatively high bandwidtli transmission medium such as a Tl or T3 line. 
,-.-.-30— Other computers in company 120 can be connected to the Internet through alternate 
routes inside of company 120. 

Note that the concepts of "client" and **server/' as used in this application 
and the industry, are very loosely defined and, in fact, are not fixed with respect to 
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machines or software processes executing on the machines. Typically, a server is a 
machine or process that is providing infonnation to another machine or process, i.e., the 
"client," that requests the infonnation. In this respect, a computer or process can be 
acting as a client. at one point in time (because it is requesting information) and can be 
5 acting as a server at another point in time (because it is providing infonnation). Some 
computers are consistently refened to as "servers" because they usually act as a 
repository for a large amount of information that is often requested. For example, a 
World Wide. Web (WWW, or simply, "Web") site is often hosted by a server computer 
with a large storage capacity, high-speed processor and Intemet link having the ability to 

10 handle many high-bandwidth communication lines. 

A server machine will most likely not be manually operated by a human 
user on a continual basis, but, instead, has software for constantly, and automatically, 
responding to infonnation requests. On the other hand, some machines, such as desktop 
computers, are t>iiically thought of as client machines because they are primarily used to 

1 5 obtain infonnation from the Intemet for a user operating the machine. 

Depending on the specific software executing at any point in time on these 
machines, the machine may actually be perfonning the role of a client or server, as the 
need may be. For example, a user's desktop computer can provide information to another 
desktop computer. Or a sen-er may directly communicate with another sener computer. 

20. Sometimes this is characterized as "peer-to-peer," conrmiunication. Although processes 
of the present invention, and the hardware executing the processes, may be characterized 
by language common to a'discussion of the Intemet (e.g., "client," "server," "peer") it 
should be apparent that software of the present invention can execute on any type of 
suitable hardware including networks other than the Internet. 

25 Although software of the present invention may be presented as a single 

entity, such buflwarc is readily able to be executed on multiple machines. That is, there 
may be multiple instances of a given softvvare program, a single program may be 
executing on two or more processors in a distributed processing cnviroiunciit, pans of a 
single program may be executing on different physical machines, etc. Further, two 

30 different programs, such as a client and serv'er program, can be executing in a single 

machine, or in different machines. A single program can be operating as a client for one 
information transaction and as a sen'er for a different infonnation transaction. 
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System Details 

As mentioned, the invention provides features for a primar\' company to 
provide services relating to video access, distribution, maintenance and management. 
The primary company operates a webpage-based client, or subscriber, front-end with its 
5 servers to allow users to search and access video. It also maintains video distribution to 
subscribers over networks such as the Internet, intranets, local area networks (LANs) etc.; 
• and provides additional infrastructure for more direct, high-bandwidlh video distribution. 

The primary company combines a series of processes designed (i) to 
improve the quality of video and audio signals broadcast (or accessed on demand) over 
10 the Public Internet; (ii) to archive, index and chapterize videos in a video database to 
allow users to search the video database for a specific portion of the video; (iii) to permit 
those broadcasting over the network to stream video only to viewers designated by the 
broadcasters; (iv) to provide broadcasters witli reports reflecting key statistical data on 
viewership patterns; and (v) provide an integrated destination on the Public Internet from 
15 which such services are available. These aspects are described in more detail, below. 

Maintenance of Multiple Video Servers 

The primary' company maintains remote video servers ar multiple Internet 
server facilities (or "co-location" facilities) , as well as client sites, throughout the worid 

20 to ensure that video is ser\'ed frorh the location that will provide the best signal to the end 
user and to provide an extra layer of "fault tolerance" in the event of a failure in any 
given CO location facility., any portion of the public Internet backbone or the like. 
Company co-location facilities are typically equipped with satellite downlink equipment, 
a video server (permitting streaming at multiple bit-rates), a disk storage array for video, a 

25 fu'ewall (to prevent unauthorized access to the machine and video signals), audio 
preprocessing equipment and computers permitting audio/video compression and 
encoding at various bit-rates. Remote senders at co-location facilities are strategically 
placed near major peering points, avoiding juajoi public peering points (such as MAE 
West and MAE East) at which packets cany'ing data are often ''dropped" due to 

30 congestion. Pacicci loss decreases video quality. Accordingly, this strategic placement of- 
remote servers, by reducing the likelihood of packet loss, presences the quality of video 
and audio viewed by the end user. 
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Distribution of Real-Time Video Signals over the Public Internet 

The primary company employs two methods for distributing real time 
broadcasts over the Public Internet: Multipoint Satellite Video Distribution and On 
5 Location Distribution: 

The primary company installs satellite downlink receivers at co-location 
facilities and other locations. Audio/Video signals are distributed to these servers by 
satellite. This method of distribution enhances the quality of real time video and audio 
signals received at the remote video servers by bypassing the Public Internet between 
10 video signal source and the video server. Using multiple video servers reduces the 

possibility of a broadcast failure to end users by eliminating reliance on one video server 
and any one portion of the Public Internet backbone. In addition, sending the signal to 
other remote video servers permits more, viewers to watch the video broadcast by 
increr^King the potenHnl number of streams of video served. This method of distribution is 
1 5 primarily used to enhance real lime broadcasts but may also be used to transfer video, 
audio and other files to remote serv^ers on demand, or by any other deliver)' .scheme. 

The original video sigtial is transported by land-line or satellite "backhaul" 
lo the satellite uplink facility where the signal is encoded into high-bitrate digital video 
and ''uplinked" lo a sateilitc that transmits to "downlink'' equipment installed at remote 
20 server locations. The signal is received by the downlink equipment and decoded by an 
integrated receiver/decoder. 

Once received and decoded by the downlink receiver, the video and audio 
signals are run through a series of steps designed to ameliorate the negative effects of 
. encoding and compie&sion algorithms which otherwise degrade the luminance and 
25 chrominance in the video, inject ancillary noise into the audio, and amplify non-useful 

portions of the audio frequency spcctruai and its dynamic raiit^c. This procedure provides 
a means of optimizing the video and audio (especially the human voice) to provide the 
best quality after the compression/encoding process. 

The video and audio signals are then run through computers that encode at 
30 various bit-rates. 1 he encoded audio and video signals are then sent digitally to the video 
server (sphtier) for distribution over the Public Internet as well as a local hard drive for 
archival (or "on-demand") use. 
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Prior to streaming video to an end-user, the Company sends test packets 
from all video servers to the end-user's desktop or the nearest network point reachable to 
the end-user's desktop and measures the return time. Video will then be served to the 
end-user from the remote server with the packet that had the fastest return time. This 
5 method permits an automatic and "split-second" determination of which remote server is 
within the closest electronic proximity to the end user's desktop, thereby enhancing the 
quality of the video received by the custom.er. 

On location preprocessing provides a lower cost alternative to the satellite 
enhanced transmission method described above. Using this method, the real time audio 

10 and video feed is run tlirough the pre-processing enhancement and encoding steps ''on 
location" prior to being distributed over the Public Internet backbone to a remote video , 
server. Once at the remote video server, the signal is sent to end users and other remote 
servers. Sending the signal to other remote servers permits more viewers to watch the 
broadcast by increasing tlie number of streams of video served. On location distribution 

1 5 still uses the Company's web video database interface and provides viewership 

information for statistics analysis. Video is sen'ed from sen-ers in closest electronic 
proximity to the end-user using the Load Balanced Video Distribution System described 
above, 

20 Video Encoding 

Fig. 3 shows a diagram illustrating how video encoding is accomplished in 
a preferred embodiment. 

In Fig. 3, a video source such as video tape recorder (BTR) 302, consumer 
VHS fomiat Video Tape Recorder VTR 304 or Digital Broadcast Satellite Receiver DBS 
25 306 represent possible sources of video data to be encoded. Note thai any suitable video 
source may be used. Although multiple sources arc shown, the encoding operation 
discussed below involves only a single video source. Naturally, given redundant 
cquiptjicnt, njulliplc video sources can be cncodc;d at the same time. 

Video switcher/splitter 308 is used to route a signal from a video source to 

- 30 - multiple destinations -ai the same lime. In a preferred embodiment, four video encoding 

processes are carried on at the same time. As illustrated by video encoding paths 3 1 0, 
312, 314 and 316. Each encoding patli operates in parallel and ultimately encodes the 
video in a different format. The resulting encoded video is stored on streaming video file 
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server 31 8 for later transfer to the Internet 320. Additionally, video switcher/splitter 308 
routes the video signal to a video/audio monitoring path 322. This allows a human 
operator to know the progress of the video encoding operation. 

Each of video encoder paths 310-316 operates in a similar manner. Each 
5 path receives left/right (L/R) audio from video switcher/splitter 308. The audio path (for 
video encoding path 3 10) is shown at 340, Video switcher/splitter 308 provides separate 
line-level audio signals for left and right, respectively, channels. The audio signals are 
passed to a graphic equalizer (eq) 342. Each left/right channel of the stereo audio signal 
is processed by the graphic eq is used to emphasize audio frequencies at about 1 kHz and 

10 to reduce the strength of the audio signals at about 20 Hz and 20 kHz. In the preferred 
embodiment, the equalizer is set to form a sinusoidal curve starting at -lOdb at 20 Hz, 
. reaching H-4db at 1 kHz and sloping back down to -lOdb at 20 kHz. The puipose of the 
graphic eq is to modify the audio signal to take care of undesirable compression 
characteristics inirodiiced at the time of encoding. 

15 Next, the signal from graphic eq 342 is sent to audio compressor 344. 

Audio compressor 344 is a stereo audio compressor that compresses each audio signal if 
die audio signal exceeds Odb. Tlie compression ratio is 8:1. Note that, although specific 
values are provided for purposes of explaining the preferred embodiment, that various 
amounts, and types, of compression may be utilized similar to the variation possible with 

20 the graphic (cq), above. The intent of the audio compressor is to even out variations iri 
the dynamic range of the audio. The left/right channel outputs of the stereo audio 
compressor arc sent to streaming video encoder format #1 (350). 

Returning to the video path of encoder path 3 1 0, the video signal is - 
provided from video swiicher/spliilei 308 and is illusU"aicd at 346. Tliis is scut directly to 

25 a streaming video encoding computer. In the preferred embodiment, the streaming video 
encoder is a rackmount rack computer with two 500 MHz central processing units 
(CPUs), a video input/digitizing card and a stereo audio input/'output card. The streaming 
video encoding computer includes streaming video compression software. The streaming 
video encoder has access to a large amount of nonvolatile storage such as a redundant 

30 array of inexpensive disks (R*MD) on a local network. 

The video input levels to the encoder are adjusted to increase saturation to 
the highest level possible without distorting the video image. Illumination level contrast 
and brightness are set to emphasize the appearance of the speaker and appearance of any 
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computer images shown by the speaker. Audio levels are set to -lOdb or-4db depending 
on audio output component of video source. 



set to produce a file with video that plays at either 24,000 bits per second (24 kbps) or 95 
5 kbps. The file resulting fi'om the encoding process is stored, via the network, in the 
nonvolatile storage. The streaming video compression process is optimized to produce a 
result with a clearer image rather than an image with higher motion. In other words, a 



As stated, the video encoding process can proceed in parallel for 4 

10 different encoding paths 310-316 shown in Fig. 3. This provides for very fast encoding 
over multiple formats. Naturally, more or less encoding paths can be used. 

Chnpterizing 

As the video is being encoded, it viewed in real-time by a human operator 
via monitoring path 322. 

1 5 While viewing, the operator (i.e., the "compressionist") detennines logical 

start and stop limes of different topics in the video presentation. For example, start and 
slop times can be subjective, as where a speaker begins to talk about a new subject. Li 
other cases, changing topics, or subject headings, can be more clearly defined as where 
the video includes a title separator betiveen video segments, etc. 

20 . The compressionist determines a set of keywords which, represent the 

content and context of each topic. Typically, the compressionist will have determined the 
start lime for the topic and will make notes about keywords used in the subsequent 
discussion of the topic. 



25 called a chapter. The compressionist captures a frame of video representing the 
presentation of the chapter and reduces it to a thumbnail size. In the preferred 
embodiment, each thumbnail is approximately 80 x 60 pixels. V^arious off-the-shelf 
software can be used to perform a capture of a frame of video. The thumbnail can be 
captured jfrom any format and at any size and is stored in any one of several popular 

30 image formats i.e. JPEG or GIF. 



In a preferred embodiment, the streaming video compression software is 



higher pixel density is favored over a higher frame rate. 



Each region of video where there is a coherent topic that starts and stops is 



Selected keywords are entered into a video program database in 
association with each chapter. Each chapter is linked to the video presentation. For 



SUBSTITUTE SHEET (RULE 26) 



wo 01/15427 



PCT/USOO/21643 



14 

example, the chapter information can exist for a file of the same name as the video 
presentation encoded different formats. Each chapter has its own thumbnail image: The 
overall video presentation is associated with its own description and its own thumbnail 
image as well. The compressionist enters the location of the streaming video on the file 
5 server in association with the video presentation, or chapter, into a video program 
database. Thus, the resuhs of a search on keywords produces a display that can utilize 
any of the text (i.e., keywords) or thumbnail images associated with chapters, or the video 
presentation, itself 

Load Balanced Video Distribution Svstem 

10 In the preferred embodiment, transfer of video information from Internet 

servers to end users, or viewers, is facilitated by distributing video files to multiple 
servers on the public Internet. Also, multiple video files can be distributed to multiple 
ser\'ers within company intranets. The preferred embodunent performs this distribution 
using off-the-shelf "mirroring software" specializing in large file distribution throughout 

1 5 noncontiguous IP networks. This software can be one of many different brands or 
internally written utilities. 

When a user logs on to the primary company's web site, the Internet 
protocol address of the user system is determined using web server analysis tools. The 
route along the Internet from the server that the user is attempting to access to the user's 

20 computer is determined using standard Inteniet protocol tools such as ''traceroute" and 
• ''ping." These tools provide a detemiinaiion of the routes currently being used to 
transfer infomiation to the user, and the time it takes for information to move to the user's 
computer. 

The geographic location of the user's computer can be determined by 
25 having the user select a geographical zone. In a preferred embodiment, the user can 
indicate their geographic location by clicking on an image of a map thai is displayed in 
the user's web browser. 

Each video server has various characteristics recorded as an entry in a 
database. This entr>' records the video server's Internet Protocol address, geographic 
30 location, total sen-'ing capacity and current staais. Additional recoi-ds track the priority 
with which each ser\'er senses viewers in each geographical zone and the percentage of 
total video requests for each video that are to be met by each server. These records are 
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used in conjunction with the network route analysis to determine the best server for each 
request. At the time a viewer requests a video, a list of servers is compiled in order of 
tlieir nearness to the user in terms of the network topology. The list is then traversed from 
the server topologically nearest the user to the server topologically farthest from the 
5 server until a good match is found. In order for a server to be considered a good match it 
must have the following characteristics. 

1) It is on-line and operating far enough below its total 

capacity that meeting this request would not overload it. 
' 2) It is configured to serve this video. 
•10 ; 3) It is configured to serve viewers in this geographical zone. 

4) It is currently serving less than its' total load percentage for 
this video. 

5) It is configured to serve this geographic zone with the 
highest priority. 

15 In the event no server has all of these characteristics, the highest numbered 

characteristic is dropped and the comparison performed again until a server i.s found. In 
the event tha( multiple senders posses all the characteristics the topologically nearest 
server is selected as a by-product of the order in which the list is traversed. 

When the server has been selected, another record is created in the 
20 database denoting that this server is sei-ving an instance of this video to this user in this 
geographical zone. This record then becomes a factor in subsequent requests by affecting 
load percentages etc. The user then recei ves, video from a server that is the best choice in 
. terais of response time, network topology, and video server utilization. 

All of a video server's characteristics can be changed at any time, even in 
25 the middle of a live broadcast, to manually direct all new users desiring the video source 
to a different server. This fine-grained configuration can be used to ensure that each 
viewer has an optimal experience and that effective utilization of all serving resources is 
reached. 

The primary company also distributes video over the Public Internet "on- 

-30 demand/* as opposed to "live," permitting end-users to view the video at any time, by 

encoding and "chapierizing" the video, transferring the video files to muhiple sen'ers on 
the public Internet, and distributing the video to users who select the video "clips" from 
those servers using load balancing techniques. 
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Although the present invention has been discussed with respect to specific 
embodiments, these embodiments are merely illustrative, and not restrictive, of the 
invention. The scope of the invention is to be determined solely by the appended clainis. 



SUBSTITUTE SHEET (RULE 26) 



wo 01/15427 PCT/US0(V2.1 ^3 

) ' 17 
IN THE CLAIMS: 

1. A method for encoding a video signal, the method comprising 
increasing the saturation level of the video signal to below visual distortion 

of the video; 

5 . selecting a high contrast level; ' 

converting the video signal to digital data; and 
compressing the digital data. 

2. The method of claim 1 , further comprising the step of 

10 optimizing the video compression to produce a result witli a clearer image 

rather than an image with higher motion. 

3. A method of encoding an audio signal, the method comprising 
increasing the volume of a predetermined frequency of the audio signal; 

15 and ' 

reducing the variabi lity in the dynamic range of the audio signal; and 
converting the audio signal to a digital data; and 
compressing the digital data. 

20 4. The method of claim 3, wherein the predetermined frequency of 

the audio signal is at about 1000 Hz. 

5. The method of claim 4, wherein the step of increasing the volume 
of a predetermined frequency further comprises the substeps of 
25 increasing the signal strength at about 1000 Hz by about +4dB; and 

decreasing the signal strength of frequencies above and below 1000 Hz by 
decreasing frequencies down to 20hz and up to 20000hz using an exponential bell shaped • 
cun'e with its peak at 1 000 Hz 

30 ' L6. The method of claim I, wherein the cncodcd..vidco signal is delivered 

in real time. 

7. The method uf claim 1, whciciii tlie encoded video signal is delivered 

on demand. 
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8. The method of claim 1, wherein the encoding steps are perfomied at an 
encoding facility, wherein the encoding steps are performed after the video is received by 
satellite transmission at the encoding facility. 

5 9. A method for distributing video over the Internet, the method 

comprising 

obtaining the Internet Protocol (IP) address of a computer or the nearest 
reachable network point used by a user to log onto a predetermined website; 

using the obtained IP address to determine the physical location of the 
10 user's computer; 

performing an analysis to detect if a local server computer exists nearest 
ihc user's computer; 

using the route analysis and IP address information to identify a server 
compuicr in proximity to the user's computer or nearest reachable network address; and 
1 5 transferring video/audio information from the server computer to the 

user s computer. 

10. The method of claim 9, wherein the step of performing the analysis 
mcluJo a suhstep of 

20 using traceroute to perform the route analysis. . , 

11. The method of claim 9, wherein the step of performing the analysis . 
includes a subslep of 

using ping to perform the route analysis. 

25 ' • ; - 

12. The method of claim 9, wherein the video is transferred on-demand. 

1 3. The method of claim 9, wherein the video is transferred in real time. 

30 14. The method of claim 9, wherein the video is transferreid live. 

15. A method of sending video information over the Internet to a 
destination computer, the method comprising 
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Storing the video information on a plurality of servers; 



designating a first server as the sending server for one or more users who 
indicate that they wish to receive the video information; and 

after one or more users begin receiving the video information then 
5 designating a second server as the sending server for one or more subsequent users who 
indicate that they wish to receive the video information. 



16. The method of claim 1 5, wherein one or more of the designating steps 
are performed automatically when a predetennined condition is met. 



10 



1 7. Tlie method of claim 16, wherein the predetermined condition is a 
threshold number of users receiving the video information from the first server. 



18. The method of claim 15, wherein one or more of the designating steps 
1 5 arc performed manually by a human operator. . 
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SYSTEM FOR ACCESSING, DISTRIBUTING AND MAINTAINING 
5 VIDEO CONTENT OVER PUBLIC AND PRIVATE INTERNET 

PROTOCOL NETWORKS 

CLAIM. OF PRIORITY 
This application claims priority from co-pending U.S. Provisional Patent 
10 Application No. 60/1 47,653 filed 8/6/99 entitled SYSTEM FOR ACCESSING, 

DISTRIBUTING AND MAINTAINING VIDEO CONTENT OVER A COMPUTER 
NETWORK which is hereby incorporated by reference, as is set forth in full in this 
document, for all puqioses. 

. 15 , BACKGROUND.OF THE INVENTION 

This invention relates in general to infomiatibn transferred over computer 
networks and more specifically to a system for processing and distributing video 
information over various types of Internet protocol networks.. 

An important feature of the global Internet is the ability to make a large 
20 amount of information available to many users. Not only should the information be 

immediately available, but it is desirable to provide for a fast and intuitive interface for 
finding the infomiaiion or content desired. 

High-bandwidth content, such as digital video, has proven to be difficult to 
* handle on the Internet. Because of the large size of video files, and the high connection 
25 speeds needed lo view the files, it is especially ijiiportaiit, yet difficult, to provide users 
with efficient ways to search and access video content. Efficient searching is necessary 
so that a user does not have lo wade through many minutes of video information to 
determine that sought-after information is, indeed, within the video program. 

One of the ways that the prior art has used to reduce video bandwidth is to. 
30 compress the video data before storing and distributing it on a network. Various 

compression schemes and data fomiats can be used. For example, MFEG, Windows 
Media, RealVideo, etc. can be used. Significant degradation or artifacts can be 
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introduced into the video data as a result of a poorly implemented encoding process. 
These artifacts result in a lower-quality video/audio experience for the end-user. 

Thus, it is desirable to provide a video access, management and 
distribution system that provides users quick access to the video content they desire, 
5 provides a system' for preparing video, or other media, for storage, access and distribution 
over a computer network, and provides the highest quality video content available over 
computer networks. 

SUMMARY OF THE INVENTION 
10 The present invention provides a system for preparing, distributing and 

accessing video content in an Internet protocol network. Aspects of the system provide 
for accessing, distributing and maintaming digital video or other multimedia content. 
Video content is acquired from content providers and prepared for Internet (or other 
computer network) access. 
] 5 Searchability of desired video content is provided to users of the system by 

linking video content to searchable text, the searchable text is accessed via a database 
where relational quenes are used to identify desired content. Portions, or chapters, of the 
video are linked to a unique text description. This allows for indexing of video so that a 
viewer, or user, can search for specific infonnation and receive access to video clips that 
20 contain the infomiation searched for, while avoiding clips that don't have any value to the 
user. 

Access of the video by end users is facilitated by maintenance of multiple 
video senders that provide access to the content. Distribution of video broadcasts can be 
in real-time or on demand. A preferred embodiment uses both satellite and locally stored 
25 digital video distribution. Video information is prerprocessed to minimize artifacts, 
. degradation and other undesirable effects that can be introduced into the video 
infonnation due to compression. The speed of transmission to an end user from each of 
multiple serv'ers is tested prior to transmission of the video stream so that the server 
closest to the user on the Internet can be used for the transmission, reducing the chance of 
'30 degradation due to network traffic conditions. 

One embodiment of the invention provides a method for encoding a video 
signal, the method comprising increasing the saturation level of tlic video signal to just 
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t .... 

below visual distortion of the video, selecting a high contrast and brightness levels, 
converting the video signal to digital data, and compressing the digital data. 

Another embodiment includes a method of encoding an audio signal, the 
method comprising increasing the volume of a predetermined frequency range of the 
5 audio signal, reducing the variability in tlie dynamic range of the audio signal; converting 
the audio signal to a digital data; and compressing the digital data. 

An aspect of the invention provides an encoding system that uses standard 
components to achieve a low-cost, efficient, and easily serviceable chapterizing and 
encoding process for handling a large amount of video processing in a uniform and 
10 parallel manner. 

Yet another embodiment provides a method for distributing video over the 
Internet, the method comprising obtaining the Internet Protocol (IP) address of a 
computer used by a user to log onto a predetermined website; using the obtained IP 
address to detennine the physical location of the user's computer; performing a route 
1 5 analysis to delect server computers between a starting server computer and the user^s 
compuier; using the route analysis and IP address infonnalion to identify' a server 
computer in proximity to the user^s computer; and tr^msferring video information from 
the sen er computer to Uie user's computer. 

20 BRIEF DESCRIPTION OF THE DRy\WINGS 

Fig. 1 shows a generalization of the system of the present invention; 
Fig. 2 A is an illustration of a computer system suitable for use with the 
present invention; 

Fig. 2B illustrate.*; subsystems of the computer system of Fig. 2A: and 
25 Fig. 3 shows a diagram illustrating video encoding in a preferred 

cmbodimem. 

DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 
A preferred embodiment of this invention is to be fielded by Technology 

30 ... Education Network, Inc., or *TENTV*\ This patent discusses system aspects of the 

invention. Other aspects are discussed in the follovying co-pending patent applications 
which arc hereby incorporated by reference as if set forth in full in this application: 
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Patent Serial No. (TBD] discusses user-interface aspects of the invention; 



and 



Patent Serial No. [TBD] discusses enterprise aspects of the invention. 



5 Note that, although the term "video" is used to refer to the specific content 

that is stored, processed, or otherwise manipulated by the subject invention, this term 
merely refers to the type of media handled by a preferred embodiment of the invention. 
The term "video" for purposes of determining the scope of the invention is defined as 
including all types of media, or content, that can be stored, distributed, accessed or 

1 0 processed in a network and/or computer system. For example, other media types within 
the scope of the invention include audio, images and data. 

System Overview 

Fig. 1 shows a generalization of the system of tlie present invention. 

15 in Fig. K network 100 represents a large network, such as the Internet, 

which includes many processing devices that perform data storage, transfer and access 
functions. In the Internet, for example, such devices are called '^sen-'er" computers. 
Ser\'ers are indicated by rectangles such as ser\'er 102. Sen-ers may perform their roles in 
isolation, such as serx^er 102. Other servers can be part of a localized network such as a 

20 network on a college or business campus, or a LAN. Collections of senders that operate • 
under the control or domain of a localized management entity, such as a corporate or 
campus network, are grouped as shown at 130. In general, the Internet allows for wide- 
ranging, diverse and changing collections of ser\^ers under control of different 
organizations as long. as the seni^ers adhere to certain well-defined standards such as the 

25 domain name ser\'ice (DNS), Internet Protocol, etc. 

In a preferred embodiment of the invention, a primary company acts as a 
sen'ice provider for video access, encoding, distribution and management. The goal of 
the primaiy company is to obtain video content and make the video content available to 
users, or viev/ers, in an efficient and economical manner. In Fig. 1 , entities 120, 130 and 

30 140 are customers of a primary cumpany which operates video origination and encoding 
services represented by 1 7 1 , 1 1 0 and 1 73. Video is distributed to customers by satellite 
link 172 directly to customers, as shown at 174, via satellite lijik to co-locatcd encoders 
and servers as represented by 11 2, 1 14 and 1 16; or directly to the Internet after encoding 
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by the primar>' company as shown al 1 10. Remote webcast 1 73 represents direct 
transmission of a live recording to the Internet as where the video is encoded in real-time 
and immediately placed onto the Internet. Still other forms of dislribuiion are possible. 
Cable networks, fiber optic, wireless or other communication chaimels can carry the data 
5 as opposed to a satellite link. All forms of network transfer are considered within the 
scope of the invention. 

Given the nature of the Internet, the video information can reside on any 
ser\'er and be accessed by any user such as user 141 . However, the quality of the video 
playback, and the speed with wllich the user receives responses to queries deptaids on a 
1 0 number of factors. For example, the speed of the netw^ork between a sending server, e.g., 
sendini; server 1 ] 2, and user 141 is a factor. The speed between company 130's Internet 
connection point and the rest of company 1 30- s users is another factor. 

The speed of each communication link between interniediar}' servers and 
between the user and the Internet affects the transfer rate, time delays and overall quality 
15 of the video transmission. In general, geographic distance can be an approximate 

measure of the quality of service that a user can expect. The closer that the user is to tlie 
sending server the more likely that the transfer rate will be faster. 

Companies such as 120 and 130 (or other entities) may wish to provide 
video content to their employees, customers, or others. However, since supporting video 
20 sen-'ers, databases and other aspects of video data management require complex 

installations of storage, servers, personnel and other resources (discussed below), such 
companies are likely to want the support of video content performed by a company such 
as primar>' company 1 1 0. Therefore, primary company 1 10 can obtain video content 
from a company, such as companies 120 or 130, and make such video content directly 
25 available to user 1 10 via primary company 1 lO's server 1 12, 1 14, and 1 16. Alternatively, 
primary company 1 lO.can make the video available through company 120's server 122. 
Thus, videos resident on sen-'er 1 12 can be transferred over the lniemet to server 122 
before being delivered to users in company 120. 

Video can be sourced at more than one ser\'er. For exainple, the desired 
- 30 video may already.be resident on scivcr 1 14 so that ihcrc is no need lo transfer video 

information from ser\'er 1 12 to sen-er 1 14. Or, the video infomiation can be on a server, 
such as server 116, thai happens lo be the closest - either geographically, or from a 
network transfer standpoint - to user 141. Satellite receiver antennas such as 1 12 and 114 
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can be used to download video or other data from satellites for fast transmission of 
information to servers on the Internet at locations 1 1 2 and 1 1.4. 

Users who do not wish to view video on their computer desktop and opt 
for viewing on a standard television or a large scale projection event in a theater can view 
5 video in real time uplinked from 1 70 to satellite 1 72 and received at company 1 74. 
Company 1 10 offers the ser\'ices of broadcasting live or taped video for viewing on 
standard televisions equipped with a satellite receiving antenna. 

The following section describes standard hardware suitable for use with 
the present invention. 

10 

Description of Hardware 

Fig. 2A is an illustration of multimedia computer system 1 including 
display 3 having display screen 5. Cabinet 7 houses standard computer components (not 
shown) such as a disk drive, CDROM drive, display adapter, sound card, network card, 

1 5 random access memory (RAM), central processing unit (CPU), and other components, 
subsystems and devices. User input devices such as mouse 11 having buttons 13, and 
keyboard 9 are shown. Other user input devices such as a trackball, touch-screen; 
digitizing tablet, etc. can be used. In general, the computer system is illustrative of but 
one type of computer system, such as a desktop computer, suitable for use with the 

20 present invention. Computers can be configured with many different hardware 
components and can be made in many dimensions and styles (e.g., laptop, palmtop, 
pemop, sealer, workstation, mainframe). Any hardware platform suitable for performing 
the processing described herein is suitable for use witli the present invention. 

Fig. 2B illustrates subsystems that might typically be found in a computer 

25 such as computer 1 00. . . 

In Fig. 2, subsystems within box 20 are directly interfaced to internal bus 
22, Such subsystems typically are contained within the computer system such as within 
cabinet 7 of Fig. 2A. Subsystems include input/ouiput (I/O) controller 24, System 
Random Access Memory (RAM) 26, Central Processing Unit (CPU) 28, Display Adapter 

30 30, Serial Port 40, Fixed Disk 42 and Network Interface Adapter 4^, The use of bus 22 
allows each of the subsystems to transfer data among the subsystems and, most 
iitipuitauily, with the CPU. External devices can communicate with the CPU or other 
subsystems via bus 22 by interfacing with a subsystem on the bus. Monitor 46 connects 
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to the bus through Display Adapter 30. A relative pointing device (RPD) 48 such as a 
mouse connects through Serial Port 40. . Some devices such as Keyboard 50 can 
communicate with the CPU by direct means without using the main data bus as, for 
example, via an interrupt controller and associated registers (not shown). 
5 As with the external physical configuration shown in Fig. 2A, many 

subsystem configurations are possible. Fig. 2B is illustrative of but one suitable 
confiiiuration. Subsystems, components or devices other than those shown in Fig. 2B can 
he added. A suitable computer system can be achieved without using all of the 
subsystems shov^'n in Fig. 2. For exaniple/a standalone computer need not be coupled to 

10 a network so Network Interface 44 would not be required. Other subsystems such as a 
COROM drive, graphics accelerator, sound card etc. can be included in the configuration 
\\ nhout affecting the performance of the system of the present invention. 

Fig. 2A is a generalized diagram of a t>'pical network. 

In Fig. 2A, the network company 120 includes several local networks 

1 5 ci>up!cd to the Internet. Although specific network protocols, physical layers, topologies, 
and other network properties are presented herein, the present invention is suitable for use 
\Mlh jn\ nciwork. 

In Fig, 2A, company 120, computer user 123 is connected to server 122. 
Thi^ connection can be by a network such as Ethernet, Asynchronous Transfer Mode, 

20 ItLl: standard 1553 bus, modem connection, Universal Serial Bus, etc. The 
comniumcaiion link need not be a v/ire but can be infrared, radio wave transmission, etc. 
scncr 123 is coupled to the Internet. The Internet is shown symbolically as a collection 
of server routers 101 and 103. Note that the use of the Internet for distribution or 
conunutiicaiion of information is not strictly necessar>' to practice the present invention 

25 but is Tuerely used lo illustrate a preferred embodiment, below. Further, the use of server 
computers and the designation of server and client machines is not crucial to an 
implementation of the present invention. User 123 fi-om company 120 can be connected 
dircciK lo the Internet. Server 122 in company 120's connection to the Internet is 
lypically by a relatively high bandwidth transmission medium such as a Tl or T3 line. 

30 Oiher compnter«i in company 120 can he connected to the Internet through alternate 
routes msidc of company 120. 

Note that the concepts of ^'client" and \*server," as used in this appHcation 
and the industry, are very loosely defined and, in fact, are not fixed with respect to 
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machines or software processes executing on the machines. Typically, a server is a 
machine or process that is providing information lo another machine or process, i.e., the 
'^client," that requests the infomiation. In . this respect, a computer or process can be 
acting as a client at one pobit in lime (because it is requesting information) and can be 
5 acting as a serx er at another point in time (because it is providing information). Some 
computers are consistently referred to as ''servers" because they usually act as a 
repository for a large amount of information that is often requested. For example, a 
World Wide Web (WWW, or simply, ''Web") site is often hosted by a sender computer 
with a large storage capacity, high-speed processor aiid Internet link having the ability to 

10 handle many high-bandwidth communication lines, 

A serx'er machine will most likely not be manually operated by a human 
user on a continual basis, but, instead, has software for constantly, and automatically, 
responding to information requests. On tlie other hand, some machines, such as desktop 
computers, are typically thought of as client machines because they are primarily used to 

1 5 obtain infonnation from the Internet for a user operating the machine. 

Depending on the specific software executing at any point in time on these 
machines, the machine may actually be perfomiing the role of a client or send er, as the 
need may he. For example, .a user's de.sktop computer can provide information to another 
desktop computer. Or a sender may directly communicate with another server computer. 

20 Sometimes this is characterized as "peer-to-peer," communication. Although processes 
of the present invention, and the hardware executing the processes, may be characterized 
by language common io a discussion of the Internet (e.g., "client," *'sen'er," ''peer") it 
should be apparent that software of the present invention can execute on any .type of 
suitable hardware including networks other than the Internet, 

25 Although software of the present invention may be presented as a single 

entity, such software is readily able to be executed on multiple machines. That is, there 
may be multiple instances of a given software program, a single program may be 
executing on iwu or mure processors in a distiibuicd piocessing cnviroamcnt, paits of a . 
single program may be executing on different physical machines, etc. Further, two 

30 different programs, such as a client and ser\'er program, can be executing in a single 

machine, or in different machines. A single program can be operating as a client for one 
infonnation u*ansaction and as a server for a different information transaction. 
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System Details 



As mentioned, tlie invention provides features for a primary company to 
provide ser\'ices relating to video access, distribution, maintenance and management. 



The primar\^ company operates a webpage-based client, or subscriber, front-end with its 
5 serN'ers to allow users to search and access video. It also maintains video distribution to 
subscribers over networks such as the Intenict, intranets, local area networks (LANs) etc.; 
and provides additional infrastructure for more direct, high-bandwidth video distribution. 



improve the quality of video and audio signals broadcast (or accessed on demand) over 
10 the Public Internet; (ii) to archive, index and chapterize videos in a video database to 
allow users to search the video database for a specific portion of the video; (iii) to permit 
tliose broadcasting over the network to stream video only to viewers designated by the 
broadcasters; (iv) to provide broadcasters v^ith reports reflecting key statistical data on 
warship patterns; and (v) provide an integrated destination on the Public Internet from 
.15 which such serv ices are available. These aspecU are described in more detail, below. . 

Maintenance of Multiple Video Servers 

The primary company maintains remote video ser\'*ers at multiple Internet 
ser\-er facilities (or "co-location" facilities) , as well as client sites, throughout the world 

20 to ensure thai video is served from the location tfiat will provide the best signal to the end 
user and to provide an extra layer of "fauU tolerance'' in the event of a failure in any 
given co-location facility, any portion of the public Internet backbone or the like. ■ 
Company co-location facilities are typically equipped with satellite downlink equipment, 
a video serv^er (permitting streaming at multiple bit-rales), a disk storage array for video, a 

25 firewall (to prevent unauthorized access to the machine and video signals), audio 
preprocessing exjuipment and computers permitting audio/video compression and 
encoding at various bit-rates. Remote ser\'ers at co-locaiion facilities are strategically 
placed near major peering points, avoiding major public peering points (such as MAE 
West and MAE East) at which packets carrying data are often ^'dropped" due to 

W congestion. Packet loss decreases video quality. Accordingly, this strategic placement of 
remote servers, by reducing the likelihood of packet loss, preserv'es the quality of video 
and audio viewed by the end user. 



The primar>' company combines a series of processes designed (i) to 
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Distribution of Real-Time Video Signals over the Public Internet 

The primary company employs two methods for distributing real time 
broadcasts over the Public Internet: Multipoint Satellite Video Distribution and On 
5 Location Distribution: 

The primary company installs satellite downlink receivers at co-location 
facilities and other locations. Audio-^ideo signals are distributed to these ser\'ers by 
satcllile. This method of distribution enliances the quality of real lime video and audio 
siunals received at the remote video serv'ers by bypassing the Public Internet between 

10 video signal soiu"ce and the video sender. Using multiple video servers reduces the 

possibility of a broadcast failure to end users by eliminating reliance on one video server 
and any one portion of the Public Internet backbone. In addition, sending the signal to 
other rcmoic video servers permits more viewers to watch the video broadcast by 
mcrcrisirvj ihc potential number of streams of video served. This method of distribution is 

1 5 pnnurjK used to enliance real time broadcasts but may also be used to transfer video, 
audio and Oilier files to remote ser\'ers on demand, or by any other deliver)' scheme. 

The original video signal is transported by land-line or satellite "backhaul" 
to the sjiclliie uplink facihty where the signal is encoded into high-hitrate digital video 
and "uplmkcd" to a satellite that transmits to "downlink'* equipment installed at remote 

20 scrvt-T livaiions. The signal is received by the downlink equipment and decoded by an 
inlcirrjicd receiver/decoder. 

Once received and decoded by the downlink receiver, the video and audio 
signals arc run through a series of steps designed to ameliorate the negative effects of 
cnc<:>dmL: and compression algorithms which otherwise degrade the luminance and 

25 chrommancc in the video, inject ancillary noise into the audio, and amplify non-useful 

portions of the audio ft-equcncy spectrum and its dynamic range. This procedure provides 
a means of optimizing the video and audio (especially the human voice) to provide the 
bcsi quality after the compression/encoding process. 

The video and audio signals are then run tlirough computers that encode at 

30 various hii-raies. The encoded audio and vidcso signals are then sent digitally to the video 
ser\ er t splitter) for distribution over the Pubhw internet as well as a local hard drive for 
archival (or "on-demand") use. 
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Prior to streaming video to an end-user, the Company sends test packets 
from all video servers to the end-user's desktop or the nearest network point reachable to 
the end-user's desktop and measures the return time. Video will then be served to the 
end-user from the remote server with the packet that had the fastest return time. This 
5 method permits an automatic and ''"split-second" determination of which remote server is 
within the closest electronic proximity to the end user's desktop, thereby enhancing the 
quality of the video received by the customer. 

On location preprocessing provides a lower cost alternative to the satellite 
enhanced fransmission method described above. Using this method^ the real time audio 
10 and video feed is run through the pre-processing enhancement and encoding steps '*on 
location" prior to being distributed over the Public Internet backbone to a remote video 
scrv cr. Once at the remote video server, the signal is sent to end users and other remote 
senders. Sending die signal to other remote servers pennits more viewers to watch the 
broadcast by increasins;; the number of streams of video served. On location distribution 
15 still uses the Company's web video database interface and provides vievvership 

information for statistics analysis. Video is served from servers in closest electronic 
proximity to the end-user using the Load Balanced Video Distribution System described 
above. 

?.0 Video F.ncnriing 

Fig. 3 shows a diagram illustrating how video encoding is accomplished in 
a preferred embodiment. 

In Fig. 3, a video source such as video tape recorder (BTR).302, consumer 
VHS format Video Tape Recorder VTR 304 or Digital Broadcast Satellite Receiver DBS 
25 306 represent possible sources of video data to be encoded. Note that any suitable video 
source may be used. Although multiple sources are shown, the encoding operation 
discussed below involves only a single video source. Naturally, given redundant • 
equipment, multiple video sources can be encoded at the same time. 

Video switcher/splitter 30S is used to route a signal from a video source to 
30 jnuhipk.dcsiinatiuns at the same time. In a preferred embodiment, four video encoding 
processes are carried on at the same lime. A.s illustrated by video encoding paths 310, 
312, 314 and 316. Each encoding patli operates in paiuUd and ultimately encodes the 
video in a different format. The resulting encoded video is stored on streaming video file 
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server 31 8 for later transfer to the Internet 320. Additionally, video switcher/splitter 308 
routes the video signal to a video/audio monitoring path 322. This allows a human 
operator to know the progress of the video encoding operation. 

Each of video encoder paths 310-316 operates in a similar manner. Each 
5 path receives. left/ri gilt (L/R) audio from video swiicher/splitier 308. The audio path (for 
video encoding path 310) is shown at 340. Video switcher/splitter 308 provides separate 
Hne-level audio signals for left and right, respectively, channels. The audio signals are 
passed to a graphicequalizer (eq) 342. Each leff right channel of the stereo audio signal 
is processed by the graphic eq is used to emphasize audio frequencies at about 1 kHz and 

10 to reduce the strength of the audio signals at about 20 Hz and 20 kHz. Li the preferred 
embodiment, the equalizer is set to form a sinusoidal curve starting at -lOdb at 20 Hz, 
reaching +4db at 1 kHz and sloping back down to -lOdb at 20 kHz. Tlie puipose of the 
graphic eq is to modify the audio signal to take care of undesirable compression 
characteristics introduced at the time of encoding. 

15 Next, the signal from graphic eq 342 is sent to audio compressor 344. 

Audio compressor 344 is a stereo audio compressor that compresses each audio signal if 
the audio signal exceeds Odb. The compression ratio is 8:1 . Note that, although specific 
values are provided for purposes of explaining the preferred embodiment, that various 
amounts, and types, of compression may be utilized similar to the variation possible with 

20 ' the graphic (eq), above. The intent of the audio compressor is to even out variations in . 
the dynamic range of the audio. The lefl/right channel outputs of the stereo audio 
compressor are sent to streaming video encoder format #1 (350). 

Returning to the video path of encoder path 3 1 0, the video signal is 
provided from video .witcher/splitter 308 and is illustrated at 346. This is .sent directly To 

25 a streaming video encoding computer. In the preferred embodiment, the streaming video 
encoder is a rackmount rack computer with two 500 MHz central processing units 
(CPUs), a video input/digitizing card and a stereo audio input/output card. The streaming, 
video encoding computer includes streaming video compression software. The slreamirig 
video encoder has access to a large amount of nonvolatile storage such as a redundant 

30 array of inexpensive disks (RAID) on a local network. 

The video input levels to the encoder are adjusted to increase saturation to 
the highest level possible without distorting the video image. Illumination level contrast 
and brightness are set to emphasize the appearance of the speaker and appearance of any 
SUBSTITUTE SHEET (RULE 2G) 
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computer images shown by the speaker. Audio levels are set to -lOdb or ^db depending 
on audio output component of video source. ' 

hi a preferred embodiment, the streaming video compression softvvare is 
set to produce a file with video that plays at either 24,000 bits per second (24 kbps) or 95 
5 kbps. The file resulting from the encoding process is stored, via the network, in the 

nonvolatile storage. The streaming video compression process is optimized to produce a 
result with a clearer image rather than an image with higher motion. In other words, a 
higher pixel density is favored over a higher frame rate. 

As stated, the video encoding process can proceed in parallel for 4 
10 ■ different encoding paths 310-316 shown in Fig. 3, This provides for very fast encoding 
over multiple formats. Naturally, more or less encoding paths can be used. 

Chapterlzing 

As the video is being encoded, it viewed in real-time by a human operator 
via monitoring path 322. 

15 Wliile viewing, the operator (i.e., the '*compressionist'*) determines logical 

start and stop times of different topics in the video presentation. For example, start and 
stop times can be subjective, as where a speaker begins to talk about a new subject. In 
other cases, changing topics, or subject headings, can be more clearly defined as where 
the video includes a title separator between video segments, etc. 

20 The compressionisi.determines a set of keywords which represent the 

content and context of each topic. T>'pically, the compressionist will have detemiined the 
start time for the topic and will make notes about kej^vords used in the subsequent 
discussion of the topic. 

Each region of video where there is a coherent topic that starts and stops is 

25 called a chapter. The compressionist captures a frame of video representing the 
presentation of the chapter and reduces it to a thumbnail size. In the preferred 
embodiment, each thumbnail is approximately 80 x 60 pixels. Various off-the-shelf 
software can be used to perform a capture of a frame of video. The thumbnail can be 
captured from any format and at any size and is stored in any one of several popular 

30 image formats i.e. JPEG or GIF. 

Selected keywords are entered into a video program database in 
associadon with each chapter. Each chapter is linked to the video presentation. For 
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example^ the chapter information can exist for a file of the same name as the video 

presentation encoded different fomiais. Each chapter has its own thumbnail image. The 
overall video presentation is associated with its own description and its own tiiunibnail 
image as well. Tlie compressionist enters the location of the streaming video on the file 
5 server in association with the video presentation, or chapter, into a video program 

database. Thus, the results of a search on ke\'\vords produces a display that can utilize 
any of the text (i.e., kewords) or thumbnail images associated with chapters, or the video 
presentation, itself. 

Load Balanced Video Distribution Svsteni 

10 In the preferred embodiment^ transfer of video information from Internet 

sen. ers to end users, or viewers, is facilitated by distributing video files to muhiple 
ser\'ers on the public Internet. Also, multiple video files can be distributed to multiple 
serv'ers within company intranets. The preferred embodiment perfomis this distribution 
using off-the-shelf "mirroring software" specializing in large file distribution throughout 

1 5 noncontiguous IP networks. This software can be one of many different brands or 
internally written utilities. 

When a user logs on to the primary company's web site, the Internet 
protocol address of the user system is determined using web server analysis tools. The 
route along the Internet from the ser\^er that the user is attempting to access to the user's 

20 computer is determined using standard Internet protocol tools such as '^traceroute" and 
'*ping/' These tools provide a determination of the routes currently being used to 
transfer information to the user, and the time it takes for information to move to the user's 
computer. 

The geographic location of the user's computer can be determined by. 
25 having the user select a geographical zone. In a preferred embodiment, the user can 
indicate their geographic location by clicking on an image of a map that is displayed in 
the user's web browser. 

Each video ser\'er has various characteristics recorded as an entry in a 
database. This entry records the video server's Internet Protocol address, geographic 
30 location, total ser\ang capacity and current status. Additional records track the priority 
with which each server serves viewers in each geographical zone and the percentage of 
total video requests for each video that are to be met by each serv'er. These records are 
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used in conjunction with the network route analysis to determine the best server for each 

request. At the time a viewer requests a video, a list of servers is compiled in order of 

their nearness to the user in temis of the network topology. The list is then traversed from 

tlie server topologically nearest the user to the server topologically farthest from the 

5 sen'er until a good match is found. In order for a server to be considered a good match it 

must have the following characteristics. 

1) It is on-line and operating far enough below its total 
capacitj' that meeting this request would not overload it. 

2) It is configured to serve this video. 

10 . 3) It is configured to serve viewers in this geographical zone. 

4) It is currently serving less than its' total load percentage for 
this video, 

;5) It is configured to serve this geographic zone with the 
highest priority. 

IS. In the event no sender has all of these characteristics, the highest numbered 

characieristic is dropped and the comparison performed again until a server is found. In 
the event thai multiple ser\'ers posses all the characteristics the topologically nearest 
server is selected as a by-product of the order in which the list is traversed. 

When the server has been selected, another record is created in the 

20 database denoting that this server is ser\ang an instance of this video to this user in this 
geographical zone. This record then becomes a factor in subsequent requests by affecting 
load percentages etc. The user then receives video from a server that is the best choice in 
terms of response time, network topology, and video, server utilization. 

All of a video server's characteristics can be changed at any time, even in 

25 the middle of a live broadcast, to manually direct all new users desiring the video source 
to a different se.r\er. This fine-grained configuration can be used to ensure that each 
viewer has an optimal experience and that effective utilization of all serving resources is 
reached. 

The primary' company also distributes video over the Public Internet "on- 
.30. demand," as opposed to *iive," permitting end-users to view the video at any time, by _ 
encoding and "chaplerizing" the video, transferring the video files to multiple servers on 
the public Inicmct, and distributing the video to users who select the video *'clips" from 
those ser\'ers using load balancing techniques, 
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Although the present invention has been discussed with respect to specific 
embodiments, these embodiments are merely illustrative, and not restrictive, of the 
invention. The scope of the invention is to be determined solely by the appended claims. 
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IN THE CLAIMS: 

L A method for encoding a video signal, the method comprising 
increasing the saturation level of the video signal to below visual distortion 

of the video; 
5 selecting a high contrast level; 

converting the video signal to digital .data; and 
compressing the digital data. 

2. The method of claim 1, furtlier comprising the step of 

10 optimizing the video compression to produce a result with a clearer image 

rather than an image with higher motion. 

3. A metl\od of encoding an audio signal, the method comprising 
increasing the volume of a predetermined frequency of the audio signal; 

15 and ' 

reducing the variabiliiy in the dynamic range of the audio signal; and 
convening the audio signal to a digital data; and 
compressing the digital data. 

20 4. The method of claim 3, wherein the predetermined frequency of 

the audio signal is al about 1000 Hz. 

5. The method of claim 4, wherein the step of increasing tlie volume 
of a predetermined frequency further comprises the substeps of 
25 increasing tlie signal strength at about 1000 Hz by about +4dB; and 

decreasing the signal strength of frequencies above and below 1000 Hz by 
decreasing frequencies down to 20hz and up to 20000hz using aii exponential belhshaped • 
curve with its peak at lOOOHz 

30 6. The method of claim 1, wherein the encoded video signal is delivered 

in real time. 

7. The method of claim 1 , wherein the encoded video signal is delivered 

on demand. 
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8. The method of claim 1 , wherein the encoding steps are' performed at an 
encoding facility, wherein the encoding steps are perfonned after the video is received by 
satellite transmission at the encoding facility. 

5 9. A method for distributing video over the Internet, tlie method 

comprising 

obtaining the Internet Protocol (IP) address of a computer or the nearest 
reachable network point used by a user to log onto a predetennined website; . 

using the obtained IP address to determine the physical location of the 
10 user's computer; 

performing an analysis to detect if a local server computer exists nearest 
the user's computer; . 

using the route analysis and IP address information to identify a server 
computer in proximity to the user's computer or nearest reachable network address; and 
1 5 transferring video/audio information from the server computer to the 

user's computer. • • 

10. The method of claim 9, wherein the step of performing the analysis 
includes a substep of 

20 using traceroute to perform the route analysis. 

1 1 . The method of claim 9, wherein the step of performing the analysis 
includes a substep of 

using ping to perform the route analysis. 

25. 

1 2. The method of claim 9, wherein rhe video is transferred on-demand. 

13. The method of claim 9, wherein the video is transferred in real time. 

30 ' 14. The method of claim 9, wherein the video is transferred live. 

15.. A method of sending video infonmation over the Internet to a 
destination computer, the method comprising 
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. Storing the video informatioh on a plurality of servers; 

designating a first server as the sending server for one or more users who 
indicate that they wish to receive the video information; and 

after one or more users begin receiving the video information then 
desiunating a second server as the sending server for one or more subsequent users who 
indicate that they wish lo receive the video information. 

16. The method of claim 15, wherein one or more of the designating steps 
arc performed automatically when a predetermined condition is met. 

1 1, The method of claim 16, wlierein the predetermined condition is a 
ihrcshi^ld number of users receiving the video information from the first server. 

1 S. The method of claim 1 5, wherein one or more of die designating steps 
arc pc-.Miinncd manually by a human operator. 
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